Equating Oral Reading Fluency Scores: A Model-Based Approach.

Words read correctly per minute (WCPM) is the reporting score metric in oral reading fluency (ORF) assessments, which is popularly utilized as part of curriculum-based measurements to screen at-risk readers and to monitor progress of students who receive interventions. Just like other types of assessments with multiple forms, equating would be necessary when WCPM scores are obtained from multiple ORF passages to be compared both between and within students. This article proposes a model-based approach for equating WCPM scores. A simulation study was conducted to evaluate the performance of the model-based equating approach along with some observed-score equating methods with external anchor test design.

Parallel reading and mathematics growth for English learners: Does timing of reclassification matter?

This study compared reading and mathematics growth trajectories in a statewide dataset of 33,715 students across third through fifth grades. Specifically, we examined growth for English Learners (ELs) who were reclassified as no longer needing English Language services at different grade levels as compared to their never-EL peers. Overall, EL students performed significantly below never-EL students on reading and mathematics assessments at Grade 3, with EL students making greater academic gains across time points than never-EL students. Students who were reclassified after third grade and after fourth grade closed, or began to close, the academic opportunity gap by the end of fifth grade, providing promising evidence suggesting that reclassification policies are adequate for identifying those students who no longer need EL services. Students who continued to be classified as EL from third through fifth grades continued to score significantly lower than never-ELs, and in many cases other EL groups, indicating that there exists a group of EL students who continue to make inadequate reading and mathematics gains across late elementary school. Implications for policy and practices that support EL students' mathematics and reading growth are discussed.

Evidence for automated scoring and shorter passages of CBM-R in early elementary school.

Curriculum-based measurement of oral reading fluency (CBM-R) is widely used across the United States as a strong indicator of comprehension and overall reading achievement, but has several limitations including errors in administration and large standard errors of measurement. The purpose of this study is to compare scoring methods and passage lengths of CBM-R in an effort to evaluate potential improvements upon traditional CBM-R limitations. For a sample of 902 students in Grades 2 through 4, who collectively read 13,766 passages, we used mixed-effect models to estimate differences in CBM-R scores and examine the effects of (a) scoring method (comparing a human scoring criterion vs. traditional human or automatic speech recognition [ASR] scoring), and (b) passage length (25, 50, or 85 words, and traditional CBM-R length). We also examined differences in word score (correct/incorrect) agreement rates between human-to-human scoring and human-to-ASR scoring. Our results indicated that ASR can be applied in schools to score CBM-R, and that scores for shorter passages are comparable to traditional passages. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Estimating Model-Based Oral Reading Fluency: A Bayesian Approach.

Oral reading fluency (ORF), used by teachers and school districts across the country to screen and progress monitor at-risk readers, has been documented as a good indicator of reading comprehension and overall reading competence. In traditional ORF administration, students are given one minute to read a grade-level passage, after which the assessor calculates the words correct per minute (WCPM) fluency score by subtracting the number of incorrectly read words from the total number of words read aloud. As part of a larger effort to develop an improved ORF assessment system, this study expands on and demonstrates the performance of a new model-based estimate of WCPM based on a recently developed latent-variable psychometric model of speed and accuracy for ORF data. The proposed method was applied to a data set collected from 58 fourth-grade students who read four passages (a total of 260 words). The proposed model-based WCPM scores were also evaluated through a simulation study with respect to sample size and number of passages read.

A two-step sampling weight approach to growth mixture modeling for emergent and developing skills with distributional changes over time.

Emergent reading skills are crucial to the development of fluency and comprehension, and as such, assessing kindergarten entry skills is critical to inform educational decisions. However, skills that are assessed too early are likely to yield many zero scores, as most students do not yet have the experience or ability to perform the task. Although these floor effects typically lessen across time to show near-normal distributions, growth models cannot accommodate repeated measures with different distributions. The purposes of this paper are to (a) introduce a two-step sampling weight approach to growth mixture modeling that addresses distributions changing over time, and (b) apply the approach to a sample of 1911 kindergarten students universally screened on an emergent reading skill (letter sound fluency) across the year. Results distinguish between students that begin at zero and make meaningful gains and those who begin at zero and do not. We discuss the methodological implications of our approach and the practical implications for growth modeling and early identification.

Growth and gaps in mathematics achievement of students with and without disabilities on a statewide achievement test.

This study estimated mathematics achievement growth trajectories in a statewide sample of 92,045 students with and without disabilities over Grades 3 to 7. Students with disabilities (SWDs) were identified in seven exceptionality categories. Students without disabilities (SWoDs) were categorized as General Education (GE) or Academically/Intellectually Gifted (AIG). Students in all groups showed significant growth that decelerated over grades as well as significant variability in achievement by student group, both at the initial assessment in Grade 3 and in rates of growth over time. Race/ethnicity, gender, parental education, free/reduced lunch status, and English language proficiency were also significant predictors of achievement. Effect size estimates showed substantial year-to-year growth that decreased over grades. Sizeable achievement gaps that were relatively stable over grades were observed between SWoDs and students in specific exceptionality categories. Our study also demonstrated the importance of statistically controlling for variation related to student demographic characteristics. Additional research is needed that expands on these results with the same and additional exceptionality groups.

In search of average growth: describing within-year oral reading fluency growth across Grades 1-8.

Measures of oral reading fluency (ORF) are perhaps the most often used assessment to monitor student progress as part of a response to intervention (RTI) model. Rates of growth in research and aim lines in practice are used to characterize student growth; in either case, growth is generally defined as linear, increasing at a constant rate. Recent research suggests ORF growth follows a nonlinear trajectory, but limitations related to the datasets used in such studies, composed of only three testing occasions, curtails their ability to examine the true functional form of ORF growth. The purpose of this study was to model within-year ORF growth using up to eight testing occasions for 1448 students in Grades 1 to 8 to assess (a) the average growth trajectory for within-year ORF growth, (b) whether students vary significantly in within-year ORF growth, and (c) the extent to which findings are consistent across grades. Results demonstrated that for Grades 1 to 7, a quadratic growth model fit better than either linear or cubic growth models, and for Grade 8, there was no substantial, stable growth. Findings suggest that the expectation for linear growth currently used in practice may be unrealistic.